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1.  Introduction 

We  assume  tnat  G  is  an  unknown  prior  distribution  on  u,  and  denote 

the  minimr  Haves  risk  in  a  decision  problem  by  r(G) .  Robbins,  in  his 

pioneering  isipers  [195b],  [1964],  proposed  sequences  of  decision  rules, 

based  an  ia'a  from  n  independent  repetitions  of  the  same  decision  problem, 

whose  ("*;  i-.i  stage  Bayes  risk  converges  to  r(G)  as  n  +  «,  Such  sequences 

of  ru It--,  are  called  empirical  Bayes  rules.  Empirical  Bayes  rules  have  been 

derived  for  multiple  decision  problems  by  Deely  [1965],  Van  Ryzin  [1970], 

Huang  [1975],  Van  Ryzin  and  Susarla  [1977],  and  Singh  [1977],  However,  the 

forms  of  densities  of  the  populations  that  these  authors  considered  are  either 

c(u)i,(x)e  x,  for  continuous  case  or  c(o)h(x)ox,  for  discrete  case,  and  the 

loss  function  are  either  squared  error  or  merely  max  o.-o.  type.  Fox 

1  j'k  1  1 

[197B]  discussed  some  estimation  problem  under  squared  error  loss,  in  which 
empirical  Bayes  rules  were  derived  for  uniform  distributions  for  the  first 
time.  Barr  and  Rizvi  [1966],  and  McDonald  [1974]  also  considered  selection 
problems  related  to  uniform  distribution  by  subset  selection  approach.  The 
problem  considered  in  this  paper  is  related  to  uniform  distributions  and  can 
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be  illustrated  by  the  following  example.  Suppose  that  there  are  k  drugs  for  a 
certain  disease,  and  the  effect  of  drug  i  follows  an  unknown  distribution  G^ , 

1  •  i  -  k.  The  effectiveness  of  drug  i  is  tested  on  n  patients  (For  different 
druqs,  different  groups  of  patients  are  used.  If  the  same  patient  has  to  be 
used  for  more  than  one  test,  let  there  be  a  wash-out  period  between  tests, 
so  the  effects  of  different  drugs  are  independent.).  Let  o.  ■  be  a  measurement 
of  the  effectiveness  of  drug  i  on  patient  j.  Drug  i  cures  the  disease  of  patient 
j  it  ^  .j  ‘)q  and  hence  is  entitled  as  a  good  drug,  otherwise  it  is  a  bad  drug, 
is  called  the  control  parameter.  In  general,  0—  is  unknown  and  will  diminish  grad 
ually  as  time  passed  by.  so  a  diagnosis  will  yield  a  result  which  we  assume 
to  be  uniformly  distributed  over  (0,  e^j).  Our  purpose  is  to  decide  on  the 
quality  (good  or  bad)  of  the  k  drugs  on  the  next  consulting  patient  based  on 
Y  -  4  (1  •  i  -  k. ,  1  •  j  n )  and  (1  ^  i  <  k),  where  X.  is  the  diagnostic 
result  of  drug  i  on  the  present  patient.  In  Section  2,  a  general  formulation 
is  given  and  empirical  Bayes  rules  are  derived  for  selecting  populations 
better  than  a  known  control  when  the  populations  are  uniformly  distributed. 

In  Section  3,  the  same  problem  is  considered  except  that  the  control 
parameter  is  unknown.  In  Section  4,  empirical  Bayes  rules  are  found  for 
truncation  parameters  (that  is  the  densities  are  of  the  form  p. (x)c^ (o . ) I ^  j(x)) 

Rate  of  convergence  is  also  discussed.  Monte  Carlo  studies  are  carried  out  for 

2 

the  priors  G ( o )  =  ^  I(q  c)(u)-  sma^es^  sample  size  N  is  determined  to 

guarantee  that  the  relative  error  is  less  than  e. 

2.  Known  control  parameter 

Assume  that  tt ^ are  k  populations  and  -  U(0,o.),  where  0^ 
is  unknown  for  1  <  i  -  k.  Let  9q  be  a  known  control  parameter,  we  define 
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to  be  ,i  good  population  if  ^  and  to  be  a  bad  population  if  Ck  f  e^. 

Let  1  ■■  =  . ^  f°r  1  i  •  k 1 .  for  any  '•  .  •},  let 

A( ,; )  -•  :  i  j  .  ■  'q  ■  and  B(  )  1  '  1  ’-j  '  “p :  >  then  A(‘>)  (B(o))  is  the  set  of 

indices  of  good  (bad)  populations.  Our  goal  is  to  select  all  the  good  popula¬ 
tions  and  reject  the  bad  ones.  We  formulate  the  problem  in  the  empirical 
Bayes  framework  as  follows: 

(1)  Let'.  ■  -S  S  -  I. L  be  the  action  space. 

When  we  take  action  S ,  we  say  c .  is  good  if  i  ,  S  and  t.  is  bad  if 
i  \  S. 


(?)  l-(  -S)  -  1  ,  •  (“ i _fln)  *"  l  /  l  ("o'" i ) 

1  v  A  )\S  1  0  ‘  if  B  H  S  0  1 


is  the  loss  function. 


(2.1) 


(3)  let  dG(  )  -  :  dii,(  ■•)  be  an  unknown  prior  distribution  on  0,  where 

i  - 1  11 


i.  has  a  continuous  pdf  q.. 


(4)  lot  (n.j  ,y.^  ),. . .  Y-n)  be  pairs  of  random  variables  from  tt  ^  and 

’ijSj  •  »<»•-«)  <°r  1  <  •  e  1  j  ■  n.  Let  Yj  .  (Y)J . Ykj), 

then  Y.  denotes  the  previous  j-th  observations  from  ^  , . .  . 

k  1 

(B)  Let  X  ( X X .  )  he  the  present  observation  and  f ( x 1 0 )  =  fi  — 

1  '  ~  i=l  °i 

l,r  ,(x,).  Since  we  are  interested  in  Bayes  rules,  we  can  restrict 

l  o ,  "  ^  /  I 

our  attention  to  the?  non-randomi zed  rules. 


(f> ) 


let  I)  -  i  /■. '  ■  :  v  •  a  is  measurable  i, 
minimum  Bayes  risk. 


then  r(G)  =  inf  r(G,6)  is  the 

t(.D  ' 


lhe  dec  ision  rules  i.‘n(x;  Y1  ’  •  •  •  ,Yn ^  !n  ■  1  ’s  5d^  to  asymPtotical  ly 
optimal  (a.o.)  or  empirical  Bayes  (e.B.)  relative  to  G  if  rn(G,6n)  - 
}F.f  l  ( ■■ ,  -  n(  x ,  Y^ , . .  .  ,  Y  n ) )  f  ( x  |  <  •  )dG(  f)  )dx  •  r(G)  as  n  -  For  simplicity, 

.  'J 


) 


4 


v 


> n ( x , Y i  . .  ,Yn)  will  be  denoted  by  6  (x). 

Let  nr  (x )  be  the  marginal  pdf  of  and  M.(x)  be  the  marginal 
distribution  of  X^.  Then  we  have 

nr(x)  -  j  ^  dG.(n)  for  all  x  ->  0,  (2.2) 

X 

and 

X  00  x  '0 

M  (x)  =  /  j  1  dG.  ( ■' ) d t  =  /  /  l  dtdG .{9)+J  /  1  dtdG.(o) 

0  t  xOl  1  0  0  1 

=  xm. (x)  +  G. (x) . 

Hence,  G.(x)  -  M^x)  -  xrrrfx).  (2.3) 

Now,  the  loss  function  defined  in  (2.1)  can  be  expressed  as 


L(,,'s) '  HL2<v“ii,(o,»0](°i»-L!<»i-VI(60,.)<ein 

*  j,  Li(”r'-'o>I(o0,.)(5i)-  <?-4> 


The  second  sum  in  (2.4)  does  not  depend  on  the  action  S.  To  find  the 
Bayes  rule  we  can  omit  it,  and  only  consider  the  first  sum  as  our  loss 
from  now  on.  Then, 


r ( G , f )  =  /  l  [/  L?(en-e.  )f(x|e)dG(o) 

-  r  n  r  I  l  w  \  t\  ^  r,  C  U  1 


c  iG  A ( x )  oi <eQ 


-  /  L]  (oi.-o0)f(x|e)dG(o)]dx. 


V°0 


So,  if  <Sg(x)  =  S*  is  the  Bayes  rule,  one  finds  i  €  S*  if 
J,  ,L2(V°i)  U.  dGi(°i} 


/  Li ( 0 i -0o >  eT  dGi (°j ) •  Hence> 


Vxi 
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S*  ■  li'x.  ■  Oq  t  1 1  ii|x^  •  o  q  and  II.  (x^)  >  c^(o0)F  where 


H.(x.)  L2ii0  /  o.  dfii  (9  j)  +  L2G  i  ^ x  i  ^ 


and 


x .  i 

l 


‘  i  ( "o )  '  L?rii^’0^+Ll^1'Gi^)0^'Ll,10  !  o  .  dGi  ( u  i )  - 

°0  1 

Since  H.(x-)  is  decreasing  in  x^  for  x^  <-  Oq  and  H { *) q )  ■  c^Bq),  so 


l  i  x 


,  - b  •  :  where  b-  >  0  satisfies  H(on-b-)  =  c,-(on).  This  shows 


'i  0  "i  1  “i  -'Jo  i'  Li'  O1 

for  any  G,  Gupta  type  rules  are  Bayes  rules  (see  Gupta  [1958,1963,1965]).  Now, 

since  G  is  unknown,  the  Bayes  rules  are  not  obtainable.  We  wish  to  find 

a  sequence  of  rules  1<S  (x)i~_i  to  be  a.o.  Let 


and 


■■G.(xi>  =  Hi(xi}  -  Ci(G0} 


( x )  ~  ’  ^  i  "  ®o ’  6g  ^ x i  ^  G 1  • 


Also,  for  any  i  (1  i  •  k),  let  Ai<n(x.)  =  A^x^  Y^.-.-.Y^)  for  all 
n  -  1 be  a  sequence  of  real-valued  measurable  functions,  we  define 


and 


Sn(x)  ■  i'Xj  ■  oQ  and  A,.^)  <  0  } 


•n(x)  -  i  1  ;xi  >  Oq}  ij  Sn(x). 


(2.5) 

(2.6) 


One  can  show  that 


Ihenrem  2.1.  If  i:<  dG ■  (  )  •  -  if  i  -  l,2,...,k,  and  A-  (x.)  ►  Ar  (x,)  in 

Q  I  I  ,  1 1  1  13  ^  1 


(p)  for  almost  all  x 


i  ‘  'O' 


Then  f<S  (x)l  ,  defined  by  (2.6)  is  e.B. 


Proof :  F or  a  1  I  5  .  <_ ,  let 
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'S  =  (xlxi  «o  if  1  t  S  and  x<  <  oQ  if  i^  SI. 

Now,  for  any  x  ■.  cs,  ,'B(x)  =  Sj  Sg(x),  then 
/L ( ■' -  l,B(x))f(xjo)dG(o) 

'  L2(t'o")i)f(xl0)dG(o)-/  L1(o.-en)f(x|e)dG(9)] 

e.>e,  1  u  *  * 


i  ’-"0 


I  -  q(x)  +  y 


i  0 


ag  (x  )  n  m  (x  ) 
i  .1  i  i  J  J 


iCS  iGSR(x)  ui  '  j/i 


where  Q(x)  =  /  L (o i-On)f(x|o)dG(o). 


Similarly,  for  x  c  ,  we  have 


/  L(o,,s  (x))f(x|o)dG(o) 


.1  -  Q(?)  +  I,  (x.)  n  m . (x . ) . 

ICS  icsn(x)  i  1  J  3 


Hence,  if  A^n(xi)  ►  Aq  (x • )  in  (p),  then 

o  ;  /  [ L ( •• , iSn ( x ) )  -  L(e,6B(x))]f(x|e)dG(e) 

■  icSZ(x)iA6i(X^-A^"^),j!lin,J(XJ) 


kSn(x) 


icSp(x)  1*n  1 


)a-  n(x.}  n  m.(x, 


j^i 


J  J 


KSb( 


l/i,n(xi>  -  AG.(xi)l  "  W 
Bv x )  i  J  J 


k 

2‘  }'  ll  m  •  (x, ) 

i=l  j/i  J  J 


(2.7) 


with  probability  near  1  for  n  x  N.  Note  that  (2.7)  is  non-positive  by  the 
definition  of  Sn(x).  Thus,  we  have  proved 


d 
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f  L(o,vSn(x))f(x|o)dG(o)  ►  /  L(o,fiB(x))f(x|o)dG(o) 

d  9 

in  (p)  for  all  most  all  x.  By  Corollary  1  of  Robbins  [1964],  { A  n ( x ) }  ^  is 

e.B.  This  completes  the  proof. 

In  view  of  (?.2)  and  (2.3),  we  have 

Cl  (x^)  L2mi(xi)('»0-xi)  +  L2[Mi(xi)-Mi(nQ)]  +  L]  [Mi  (oQ)-l  ]. 

i 

Hence,  i f  we  define 

Ai,n(xi>  =  L2n'i,n(xiHVxi)  +  L2CMi,n<xi)-M1,n(eO)3 

+  Ll[Mi,n(00)'1]  (2‘8) 

Wher(‘  Mi,n<x)  =  i  I(-»,x](Yij) 

and  urn  )n(x)  =  pj  tMi,n^x+h^  '  Mi,n^x^’  (2-9) 

then  *f  n(x^)  •  Ag  (x.)  in  (p)  a.e.  in  x,  if  h  =  h(n)  -►  0  and  nh  +  »  as  n  +  ». 

So,  by  Theorem  1,  6*(x)  =  ( i  |  x^  >_  0^1  >j  ( i  |  x  ^  <  eo,AT,n^xi^  -  ’s  e'®' 

Remark:  In  (2.8),  M.  (x)  and  m.  (x)  can  be  defined  as  any  functions  such 
—  ~  i ,  n  *  i  n 

that  M.  Jx)  >  M.(x)  in  (p)  and  m-  (x)  •>  m.(x)  in  (p)  for  almost  all  x. 
t  ,n  l  «5''  * 

,,  1  n  x'Yii 

lor  example,  let  mV  ^(x)  =  ^  Ji  w(  --p—-)  where  w(  • )  ^  0  satisfies 

(i)  sup  w(x)  ■  K  for  some  constant  K, 
x-  > 

( i  i )  J  w( x )dx  -  1 

( i  i  i )  1  i  m  xw  ( x )  -  0 

x 
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and  h  -  h(n)  satisfies  h  ►  0,  nh  ■>  »>  as  n  ♦  *>  then  m°  (x)  is  a  consistent 

i ,  n 

estimator  of  m.(x)  (see  Parzen  [1962]). 

3.  r'Q  unknown 

Let  p  be  a  control  population  and  Hg  -  U(0,Og)  with  0g  unknown.  Let 

^01 ’ ' ' ' ’ Y0n  the  past  data  collected  from  Hg.  Based  on  this  further 

information,  we  will  search  for  empirical  Bayes  rules  for  selecting  populations 

better  than  control.  Note  that  now  u  =  (Og,^  , . . .  ,ek) ,  x  =  (xg,Xl , . . .  ,xk)  and 
k 

Gi'  )  =  :  G-j  ( ,J-j )  •  Under  the  loss  function  in  (2.4),  the  Bayes  rule  is: 


’  'B(x)  if 


L?  i  %  in1'..  t.,.  57  <V»f)<JGi(.l()dG0(»0) 


Xg  o  (0,Og];i(xi ,'«.)  i 


V,  o 


Hence,  :  -R(x)  if 


(i)  x^  *q  and  Cq  q  (xq*x^)  L.  G>  where 


Gg,G.  ^x0,xi  ^  =  (LrL?)]/  m4  ^ °0 ^dG0^ 80 ^  +  /  mo^ei  )dGi  (ei  ^ 
1  xi  xi 

-  L1[l-Gi(xi)]>n0(x0)+mi(xi)[L2+(L1-L2)G0(xi)-L1G0(x0)] 

>r 

(ii)  x.  •  Xg  and  Cg  g.^xo,xi^  G  g>  where 

2  '*  IX> 

;Gn,G.(x0’xi)  1  (LrL2)[/  mi^’o)dG0^eO^  +  /  nio(oi)dGi(oi)] 

t*  ^  xn  xr> 


j(xg) [i-i +  (L2*Li  )Gi  (xg)-L2Gi  (xi )]  +  L2m.  (x.  )(1-Gq(xq)  ) . 
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When 


L1  L.,  -  L,  the  Bayes  rule  is  qreatly  simplified.  We  find 


i  .  -R(*)  if 

■  ^  m0U0)[l-r.i(x.)]-m.(x.)Ll-G(J(x0)]  0. 

0  i 

1  et.  ‘  \\)  i  (x  ,  x,,  1  0 1  whore 

n  i ,n '  i  0 

i,n  t’  0  o,n  n'1  i,n  i/J  i,n'  vL  0,nk  0  J 

is  defined  in  (2.9),  and  Gi  ^n(x1- )  =  n (xi ) 

-  v  |.j,  r|  ( >  ) .  Then,  i  '•  vx)  n„j  i  e.B.  by  fheoren  3.2.  When  L-|  f  L^, 
me  needs  to  find  consistent  estimators  of  /  rn .  (o^  )dG^(uQ )  and  /mg(G.j  )dG^  (6 . 


nee r  er  •: .  1  . 


et  M.  [/)  and  re  (x)  be  defined  by  (2.9)  with  h  =  h(n) 


■  at  i  s T  v  i  m;  h  ■  0,  nn 


as  n  •  ■.  If  i‘)  dG.('i)  <  ■  for  all  i  =Q,l,...,k, 

6  1 


' '•■■n  -  '  v:i  .  ( /  , ,■  jm  {>.)  •  ’  "  j  ( x  )dG,,(x)  in  (p)  for  any  a  0. 

a  '  '  a 

;:i  •>  >  :  1  re  /'upend  i  x  A  . 


T non Assume  that  , dG.(  )  •  .  for  all  Q  ■  i  ■  k.  If  for  all 

0  1 

1  1  k-  iV-VV  •  'Gi.G[)(x0’Xi)  in  (p)  for  xi  x0’  and  Ai,n(x0’xi} 

,  •)  in  fp)  for-  x-  •  Xq.  Then 


ri ' 


x r.  «>nd  .  ■  Oij 

0  \  ,n  0  l 


<n  and  *  .  ( x,  ,  x. .  )  •  0  - 

0  i,nv  0  i 


(3.3) 


define-,  an  enipiri(.al  Bayes  rule. 


Proof:  /  L  ( r » ,  .  ( x ) )  f ( x  i o ) tlG ( •  > ) 


]  2 
l  Ar  r  (xn,x.)  il  m.(x.)  +  [  Ar  r  (xn  x,)  II  m •  ( x  • ) 

ics*(x)  Gi’G0  0  1  .i/i  J  J  ics*(x)  Gi’G0  0  1  J  J 


whore  S?(x)  =  f  i  ! x -  >  xn  and  Ar  r  (xn,x.)  <-  0! 

!  'I  U  b . , b~  U  1 

1  0 

2 

S*(x)  =  fi  x.  •  xQ  and  Ag  ~  (xq,x-)  •_  0), 

i  ’  0 

and  /  L( >■ , A*(x)  )f  (x  J  o )dG(o ) 

i  2 

=  }'  V  r  (xn,x.)  !!  m.(x-}+  j  A  r  r  (xn,x.)  II  m .  ( x  ■ ) , 

<'%  0  w  J  J  3,.  GrG  o  0  ’  jo  J  J 


itsp(x) 


iesn(x) 


Now,  followinq  the  same  method  as  in  the  proof  of  Theorem  2.1,  we  can  show 


l  'f  G  (x0,x.)  n  m.(x.)  -  l  ag  G  (x0,xi)  n  m.(x.) 

i,s  ( x)  i'’  0  J  J  i€S*(x)  Gi’  0  U  1  j7i  J 

rr' 

in  (p)  for  .  -1,2.  Hence  i6*(x)}”=^  is  e.B.  This  completes  the  proof. 


Now,  let 


i,n(x0’*i)  '  (L2'L1)(/  xmi,n(x)dm0,n(x)  +  /  xm0,n(x)dmi ,n(x) } 


L1  [1"Gi  ,n(xi  )]m0,n(x0)+mi  ,n<xi  )tL2+<LTL2) 
G0,n^xi^'LlG0,n^x0^’ 


Ai,n(x0’xi}  =  <L2-L1)!/  xmi,n(x)dm0,n(x)  +  /  xm0,n^x)dnli ,n(x) 


+  L2^'G0,n^x0^mi,n^xi  ^"m0,n^x0^Ll  +  ^L2‘Ll  ^Gi  ,n^x0^ 

L2Gi,n^xi^’ 

where  G.>n(x)  =  M->n(x)  -  xm.^x). 


(3.5) 


Then,  by  Theorem  3.1  and  Theorem  3.2  (3.3),  (3.4),  and  (3.5)  define  an 
empirical  Bayes  rule. 

4.  Generalization  and  Simulation 

Let  p-(x)  be  a  positive  continuously  di fferentiable  function  which  is 

1  -1  0 
defined  over  (0,-)  for  1  <  i  <  k.  Let  c.(o)  =  /  p.(x)dx  for  6  >  0,  then 

7  0  7 

f-j(x|e)  =  pi  (x)ci  ( o )  I  Q)(x)  is  a  density  function  and  o  is  a  truncation 
parameter.  In  this  section,  we  assume  that  -  f..(x|o.)  for  1  1  i  £  k. 

Under  the  formulation  of  Section  2,  we  wish  to  find  empirical  Bayes  rules 
for  these  more  general  density  functions.  For  simplicity,  we  assume  that 
L-j  =  L^  =  L  and  that  Oq  is  known.  Also  we  assume  G^(o)  has  a  continuous 
density  g.(o)  with  a  bounded  support  [0,ot^]  with  a  known  for  all  1  <_  i  <_  k. 
We  find 

ai 

m,(x)  =  !  f .(x|G)dG.(e)  =  p Ax)J  c,(o)dG.(e). 

1  0  7  1  1  x  7  1 

If  we  follow  the  same  discussion  as  in  Section  2,  we  can  show  that  the  Bayes 
rule  <5g  is  i  €  6g(x)  iff 

(i )  xi  >_  eQ  ,  or 

01  i  “i 

(ii)  x.  <  eQ  and  oQ  /  c. (x)dG.(x)  <  /  xc.  (x)dG. (x) . 

x  x. 

“i 

Hence,  ,s„(x)  =  { i  | x -  >  on-d  - 1  where  d.  -  0  satisfies  /  (en-x )c .  (x)dGi (x)  =  0. 

8  -  “  '  1, 

Get  d.  n  "  d.  n(Y^i ,. . . ,Y^n)  be  a  consistent  estimation  of  d^ ,  then 

Ox)  =  { i  ( x ^  >_  nl  is  e.B.  and  they  are  (weak)  admissible  in  the 

sense  that  6^( • ,Y^ , . . . ,Y  )  is  an  admissible  rule  for  the  non-empirical  problem 
for  «11  Y^,...,Yn  and  n  (see  Houwelingen  (1976).  Meeden  (1972)).  However, 


to  find  such  a  sequence  [di  }^=1  is  very  difficult.  In  view  of  Theorem  2.1, 
a  more  practical  way  to  find  empirical  Bayes  rules  is  to  estimate 

•X  . 

/  xci(x)dGi(x). 
xi 

Theorem  4. J.  Let  p.(x)  and  G.(x)  be  defined  as  above.  If  m.  (x)  is 

-  -  i  i  i  ,n '  ' 

defined  by  (2.9)  with  h  -►  0,  nh  *  ■», 


o t .  i  /  v  a . 

1  Xp.(x)  1  „ 

a . 

1 

>■  /  xci  (x)dGi  (x)  in  (p). 


Proof:  See  Appendix  B. 


Now,  let 


o„m.  (x- )  ai 
A*  (v  \  -  0  _  1  J.  [ 

i  >n  Xi  pJxTJ  l  P, 


1  '  1  '  X 


i  x  ,  xpj(x) 

.  P^*T*1.n<x>  -  /  ~^mi,n(x)dx’  (4J) 


then  «*(x)  =  t i ( x^  >  0Q}  u  O |x1  <  eQ  and  At  n(xi )  £  0} 
defines  an  empirical  Bayes  rule. 

The  following  lemma  is  a  direct  result  of  Lemma  3  of  Van  Ryzin  and 
Susarla  [1977]. 


Leona  4 


^q.(x)  /  (®o”t)C-j  (t)dG^ (t)  ^(o,a.)^X^* 

IX  i 


then  0  <  rn{G,6*)  -  r(G)  =  { /„! | ag  (x) |p{ (x) |P[a* ^(x)  <  0]dx 

+  /H2|AG.(x)|Pi(x)ptAt,n(x)  >  0]dx] 
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where  A*  n(x)  and  6*  are  defined  by  (4.1)  and  (4.2)  respectively,  and 
1  7 

H.  =  lxlx  '  *q  and  ag  (x)  ■  01  and  fC  =  (x|x  and  (x)  <  01. 

bi  i 

0(a) 

Now,  let  0(.<  )  denote  a  quantity  such  that  0  <  1  im - <  Th 

n  a 

n 

since  j/.g  (x)|p.(x)  •  M.  for  all  x  Oq  for  some  constant  ,  so 

k 

rn(0, '*)  -  r (G)  <  l  M. { /  p [a* ^ n ( x )  <  0]dx 
i  ~  1  ..I 


+  /  P[Af  (x)  >  0]dx} . 

p  1,11 

H 

1 

Therefore,  if  for  all  x  <  e~ 


P[|Ai,n(x)-'G.(x)'  iAc. (x) H  =  °(«n) 


rn(G,6*)  -  r(G)  =  0(an). 


Now,  by  the  inequality 


Var[A+  (x)] 

n  '■*  n*x)-AG  (x)'  ■  |  A  (x) !  ]  <  — - - ; 

^  [|AG_(x)!-|AG  (x)-EA|>n(x)|]‘ 


we  conclude  that  if  Var[A|  n(x)]  =  0(an)  for  all  x  £  0 q  then 


- r(G)  -  »<■•„>• 


In  the  following,  we  have  carried  out  some  Monte  Carlo  studies  to  see 

how  fast  the  derived  empirical  Bayes  rules  converge.  We  let  ~  U(0,e^) 

26 

for  i  -  0,1.  Qq  is  treated  as  an  unknown.  Assume  that  g^(e)  =  I^q  c)(0) 
for  i  =  0,1  and  =  1 .  The  smallest  sample  size  N  such  that 


Relative  error  = 


rm(G,6J)-r(G)| 
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for  N-4  m  ^  N  is  determined.  The  values  of  N  corresponding  to  selected 

-1/4  -1/5 

e  and  c  are  shown  in  the  next  table  for  h  =  n  ,  for  h  =  n  and  for 
h  =  n"^®,  where  h  is  used  to  define  (2.9). 


because  of  limited  resources). 
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Appendix  A 


Proof  of  Theorem  3. 1 . 


For  i  fixed.  (  xm.  n(x)dmn  (x) 

Q  '  U  ,  I  1 


n  n 


i  i 

o  _  _ 

n“  h  j  =  l  f.=l  a 


9  -7  l.  1.  f  x  1 


(x,x+h](Yij)dI[Yorh.Y0e)(x) 


n  n 


V  1_2  L  l  ^irV*’  where 

n  n  j=l  c=l  J 


Ujp  =  (Yorh)I(a,-)(Yorh)I(Yorh,Y0ll](Yij) 

Vjt.  =  Y0KI(a.-)(Y0«.)I(Y0i,Y0jl+h](Yij)- 
Since  Y~  Mn(x)  and  Y.,  ~  M.(x)  for  1  <  j,  l  <  n,  so 

UV.  U  1J  1  “  ~~ 

E/  xmiin(x)dm0)n(x)  =  ^  E[UirVn] 

,r  i  x+h  1 

=  /  x  h  /  dMi(y)  K  [m0(x+h)>mo(x)]dx. 
a  x 

Now,  by  (2.2)  iik  (x)  is  decreasing  in  x,  hence 
i  x+h  1 

~f  dM.(.y)  <  mi(x)  <  j  [l-G^x)]. 

x 

i  x+h  l 

Then  |x-  ^  /  dM.(y)  ^  [m0 ( x+h ) -m0 ( x ) ]  | 


(A.  1 ) 


x+h 


1  A  11  1  1 

Cl -Gi (x) ]  £  /  ~  dG0(e)  <  ~  g0(x+6h),  for  some  6  e  [0,1]. 


The  last  term  is  integrable  over  (a,°»),  then  by  LDCT 


V 


E/  xmi  ,n^^dmO,n^x^  '*■  /  xmi  (x)m^(x)dx 


/  mi{x)dGQ(x)  in  (p)  if  h  *  0  as  n  ». 


No„,  Var  /  »,  _„(« )<*»0,nW  =  Var  \  lj  J  (u  -»  ) 


n  h  j,z 


A*  Var(uirvn)  +  ixlcov(uirv1r  u12-v12). 


But  Var(U11-V11)  -  E[ (U]  1  -V]  1  )2]  =  E(U^)  +  E(V?, )  [because  UnVn  =  0], 


and  ]h  E(uf1 


w  p  1  X-rn 

=/  X  ■  i  I  dMi(y)dM0(x+h) 


^  /  x  '  x  (,_Gi (x) )dMQ(x+h)  <  /  x  dMg(x+h ) 

^  d 

mg  g 

<  E  °[X]  =  E  O[E[X|0()]]  =  1  E  °[e0]  < 

1  Gn 

hence  h  Var(U„-Vn)  <  E  U[0Q]  for  all  h  >  0.  (A. 4) 

Meanwhile,  CovO^-V^,  U12-V12)  =  Cov (U-, ]  ,U-, 2 )  +  Cov^.V^-CovO^  ,V12). 
Cov(vu*U12).  and  |’?  Cov(U]1  ,U]2)  |  <  ^  CE(U11U]2)  +  E(Un  )E(U]2)]  because 
U  j  f  0  for  all  1  <  j ,  e  <•  n . 

Now,  4  E(unU12)  =  72  7  C  /  ydM0(y+h)]2dM.(x) 

h  h  0  (a )n[x-h ,x)  u  1 

1  '%  A  ?  i  a+h  x  „ 

=  h2  a+h 4-h  ydM0(y+h)]  dMi(x)+  J?  f  U  ydM0(y+h)]2dM.(x). 

X  X  00 

Because  /  ydM  (y+h)  *  /  y  /  I  dGn(e)dy 
x-h  u  x-h  y+h  0  u 

x  ^ 

-  /  y'y+W  'dy  -  h>  and>  similarly. 
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x  a+h 

/  ydMQ{y+h)  <  /  ydMQ(y+h)  <  h  for  a  <  x  <  a+h, 
d  d 

we  get  ^  EfU^U^)  <  l-N-(a+h)  +  H^a+h)  -  M^a)  =  l-M^a). 
h  ^ 

The  same  argument  shows  that  E(U^  )  <  1 -Mi (a ) 

J-  E(Vn)  <  1  -M-  (a ) , 

hence  I--  Cov(U] }  ,U]2)  |  <  2[1-M1  (a)].  This  implies  that 
h 

!Cov(U11-Vn,U12-V12)|  <_8  [1-Mi (a)]  for  any  h  >  0.  (A. 5) 

h 

By  (A. 3),  (A. 4)  and  (A. 5) 

Var  /  xm-  (x)dmn  (x)  -*-0  if  nh^  ■+  0  and  h  -*•  0.  (A. 6) 

J  1  y  It  U  )M 

d 

Now,  (A. 2)  and  (A. 6)  implies  that 

/  xm.j  n(x)dm0>n(x)  -  /  nii (x)dG0(x)  in  (p). 


This  finishes  the  proof. 
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Appendix  B 


Proof  of  Theorem  4.1. 


First,  E  /  p*W  dmi>n(x)  =  /  ^7  J  K  (x+h)-m{  (x)]dx 

xi  1  Xi  1 

>  /  p.fxl  dn1i(x)  by  LDCT‘ 
xi  1 

Now,  Var  /  --^y  dmi,n(x)  =  Var^Hh  X,  (UfV-* 
where  Uj  =  p.T^^hJ  dnd 

Vj  =  PTC^T  I[xi,ai](Yij)- 
ai 

Hence,  Var  f  --fa  dmi  n(x)  =  77  Var(U}-V} ) 
x .  *1 '  '  ’  nn 

<  -Ig  E[(UrV1)2]  =  l  f  ^  (pTfxy  '  ^hT)]2dMi(x) 

dM.(x) 


7+h 


a.  +h  xi+h,  2 

1  r  1  r  X-h _ -i2  \  .  1  r  1  x 


*  **£,£,]  *»*[,“  3^ 


0  if  nh  -*•  ®. 


dmi,n(x) 


dm^x) 


in  (p). 


\ 


We  see  that 
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li  xp!(x)  “i  xp!(x) 

Similarly  f  m.  (x)dx  ►  /  — 5 - m.(x)dx  in  (p). 

P<(x)  1>n  x.  pf(x)  1 

'  ’  “i  ,  m.(x) 

Since  ;  xc^(x)dGi(x)  =  f  -x  dx  l^y] 

xi  xi  1 

'i  xpj  (x)  "i 

=  /  Y/7  mi(x)dx  -  /  p.Tx7  dmi (x)  ’ 

x.  p^x)  x.  n 


the  proof  is  completed. 
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